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ABSTRACT 

Two methods to improve ths teaching performance of 
clinical teaching physicians were studied: an intensive feedback 
method end a seminar. Both aethods vere dasigned to help clinical 
teachers analyze their taaching and implement more effective teaching 
aethods. Pre- and post-intervention data ware collected eerly and 
late in each attending physician's 1-month teaching rotation. In 
addition to conaidaring clinical teachers/ evaluation of the methods 
and teacher self -assessments r feedback was provided by student and 
housestaff ratings of the teachers, end videotape ratings of actual 
clinical instruction made by trained raters. Comparisons were made to 
teachers who only received written feedback from students and 
housestaff. The seminar method presented specific examples of 
clinical taaching, including viewing re-enacted videotapes of 
clinical rounds. The method also facilitated discussion of 
videotepes, teacher's review of student and housesteff retings 
compared to self-ratings, and teacher's identification of desirad 
taaching changes. Research results indicate that effective methods of 
improving clinical teeching cen fce developed. Five recommendations 
for use of the methods are offered, including providing educational 
tools/concepts applicable to the teaching setting. (SW) 
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The improvement of clinical instruction is a complex task 
which encompasses! 1) the identification of the needs of 
faculty members, 2) the development of effective methods to 
address those needs, and 3) the involvement of faculty in the use 
of the methods. As shown in Stritter's review of research in 
faculty development (1983), there is a strong need for continued 
empirical research in each of these areas. In this symposium, 
results of 6 years of research directed towards the development 
of methods to improve attending physicians' teaching will be 
presented. Discussion will focus on how these results both 
further our understanding of critical issues in teaching 
improvement and indicate directions for future work. 

In identifying the needs of clinical teachers, at least two 
components should be considered i teachers' attitudes and 
teaching performance. In our research we have assessed clinical 
teachers' attitudes toward clnical teaching in general as well as 
their opinions regarding their own teaching. Two main findings 
emerged from this research. First, all of the 110 attending 
physicians who participated in our studies indicated that the 
role of the attending physician has general importance to medical 
training as well as personal importance to the individual 
teacher. Second, when rating their own teaching, these teachers 
generally gave themselves lower ratings than they were given by 
their own students and housestaff (Skeff, Campbell, and Stratos, 
1984). These findings indicate that clinical teachers view 
their role as being important, and that they recognize that their 
performance could use improvement. 

The study of teaching performance can provide information 
about teachers' needs which supplements that derived from 
teachers' attitudes and perceptions. Two major conclusions may be 
drawn from our studies. First, videotape analysis indicates that 
clinical teachers need improvement across a wide range of 
educational areas. For example, when teachers were rated by 
trained raters on a set of educational concepts (including, e.g., 
management of session, communication of expectations, 
evaluation), the average score for each concept on a 5 point 
s*cale was less than 2.5 (Skeff, Campbell, and Stratos, 1984). 
Second, the individual needs of clinical teachers are likely to 
differ. Following participation in a teaching improvement 
method, attending physicians were asked to identify changes 
needed in their teaching. Categorization of the lists of changes 
generated by these teachers showed great variation across 
individuals (Skeff, Campbell, Stratos, Jones, and Cooke, 1984). 

To address the needs of clinical teachers, we have developed 
and studied two methods, an Intensive Feedback Method and a 
Seminar Method. These - methods share two goalst 1) to guide 
teachers in the analysis of their teaching, and 2) to generate, 



and aid teachers in the implementation of, more aft active* 
teaching methods. The effectiveness of these teaching improvement 
methods was aeseeeed uaing an experimental design in which pre- 
and post-intervention data were collected for all subjects. Thm 
data were collected early and late in each attending physician's 
one-month teaching rotation. The methods were evaluated on thm 
basis of the following sets of datai i> attending physician 
assessments of the benefits of the method, 2> teacher self- 
assessments, 3) student and housestaff ratings of their teachers, 
and 4) ratings of videotapes of actual clinical instruction. 

The Intensive Feedback Method consisted of a one-hour 
session in which a facilitator-colleague helped the teacher 
review several sources of feedback regarding teaching 
performance. These sources included! 1) a videotape of— thm 
teacher's attending rounds, 2) the teacher's self -assessment 
ratings, and 3) ratings of the teacher by students and 
housestaff. 

The effectiveness of the method was assessed by comparing 
subjects who received the method to subjects who reveived written 
feedback from students and housestaff and to subjects who 
received no intervention (Skeff, 1983). The results of 
questionnaire data indicated that this method was perceived as 
beneficial by the teachers who received it. It is notable that 
no more than 50% of subjects who received onl'y written feedback 
from students perceived that method as beneficial, in spite of 
the fact that student questionnaire feedback is the most common 
teaching improvement method in use today. 

Videotape ratings were made by trained raters who were 
blinded to the experimental assignment of the subjects. Ratings 
were made across six relatively high inference aspects of 
teaching including 1) teacher awareness of learners, 2) learning 
climate, 3) evaluation of and feedback to the learners, 4) 
organization and clarity, 5) teacher's use of techniques to 
increase retention, and 6) management of the teaching session. 
In addition, ratings of overall teaching performance were made. 
As shown in Table 1, post -treatment ratings on both the overall 
ratings and the average category rating revealed higher score* in 
the experimental group, indicating a positive effect of the 
method. It is interesting to note that on the average score, the 
ratings indicated that a major cause of the difference between 
experimental and control groups was due to a decrement in scores 
of the control group. 

TABLE 1 
Rating* of VMiOtiptd Tw c Wn j Pfffannmtmt 



MsJfef&Pelmf SpfCttO CmtefeTett ef 

FmmfcwBi Fwi-TfiihtwS ftWMtwwt PWfcTmtwmi 

ggjgj ~em{»r Tjjggg gang 

kmnsfcefMeacfceve 3.42 (0.62) 3.94(0.60) 345(0.39) 337 (0,50) 

VMwrtSWeomralyo M p 3.43(0,69) 3.61 (0.69) 3.36(0.46) 3.09 (0.46) 
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Although the teacher* perceived benefits of the method end 
the videotape ratings indicated that it had a positive effect* 
the ratings of the students and housestaff did not show 
significant differences between the different treatment groups ( 
Table 2). The reasons for this finding are not completely clear, 
but tNo possible explanations may be that 1) the initial opinions 
of students and housestaff are difficult to change, and 2) the 
relatively high initial ratings by the students created -a 
-ceiling effect". 

TABLE 2 



Evaluation d ToocMwg by Tralnf O n — U onn t r— (Fiw-Potnl Seas) 





Avfraotcf 45 Ow 


jeafcawatt ttm* 


0mm8 ftrit 








PQeMfSjtntlflt 




8^sst*TrSeellQai 




ekaS^) 


Sun 05)' 






Intent** feedback group 
VMsJOMbpF control flwmp 
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4.09(0.34) 
4.32(0.38) 
4.19(0*42) 
4.08(0.52) 


4.17(0.34) 

,4*30 (0J4) 
4.31(0.41) 
4.18(0.63) 


4.18(0.52) 
4J2 40.58) 
4.22 (0.73) 
345(0.74) 


4J3 (0.55) 
439(077) 
4.40(0.71) 
417(0.83) 


• AM p vatuts nonsignificant (analysteof ccvarianct). 



Although the results of the Intensive Feedback Method 
appeared promising, there are several drawbacks to the method. 
First, it requires an extensive amount of facilitator time. It 
is the opinion of the authors that few institutions could provide 
enough facilitators to have an impact upon the majority of 
clinical teachers around the country. Second, although each 
individual teacher benefited from the review of his own teaching, 
other teachers were not able to gain from his experience. 
Because of these limitations on the numbers of potential 
beneficiaries, we developed a seminar method for use with groups 
of attending physicians. 

The design of the Seminar Method draws upon the process of 
experiential learning (Kolb, 1981) in r ch concrete experiences 
are used to derive abstract concepts whi r , .-nay then be applied to 
future behaviors. The Seminar Method presents specific examples 
of clinical teaching to familiarize participants with educational 
concepts relevant to clinical instruction (Gagne and Briggs, 
1979? Skeff, 1983). The method includes five major components* 
1) the viewing of re-enacted videotapes of actual attending 
rounds, 2) facilitated discussion of the videotapes, 3) 
facilitated discussion of educational concepts relevant to 
clinical teaching, 4) the teacher's review of his/her ratings by 
students and housestaff as compared to his/her own self- 
assessment ratings, 5) the teacher's identification of desired 
teaching changes. 

The seminars, which are conducted by a physician trained in 
the method, have the following format. During a period not 
exceeding 2 hours, participating attending physicians view 
videotaped re-enactments of actual clinical teaching sessions. 
Each videotape lasts 3-5 minutes and is selected to exemplify 
both specific problems faced by clinical teachers (e.g., 
addressing learners at several levels simultaneously) and general 
educational concepts relevant to clinical teaching. These 
concepts include the learning climate (i.e., the tone of the 



teaching union including level of stimulation and comfort), 
communication of the teacher's expectations, control of the 
teaching session (i.e., the teacher's ability to keep the session 
f^lL focused), evaluation and feedback, techniques to 

earned ST^SSS^S!! *"2 retention (e.g., questioning thZ 
„ f ?! * ° Check on understanding, emphasizing important 
points), and stimulation of further learning (e.g., enco^agfng 
!" r ; h f[ r »«ding, ^encouraging consultation). The seminar leader 
elicits commentsVrom each participant regarding the educational 

s ™ °" ^eXtapes. Using the participants' comment 
J^Zlli facilitates a discussion of the previously described 
educational concepts. Following the discussion of each tape, 
AftSr ITl SiE - !! t , re f°^» desired changes in his/her own teaching. 
After- all the selected videotapes are discussed, each participant 
receives a computer printout comparing ratings of his teaching by 
f^ln^nn With 4 his own «el f -eval uat i on ratings. On the da^ 

following the seminar, each participant receives a written 
summary of the seminar discussion for future reference. 

As with the Intensive Feedback Method, the Seminar Method 
was evaluated on the basis of attending ohysician assessments of 
the benefits of the method, teacher self -assessments, teacher 
ratings by their students and housestaff, and ratings of 
videotapes of actual clinical instruction. This method was also 
assessed using an experimental design with pre- and post- 
lrftervention measures collected on all subjects. The data were 
collected early and late in the attends : physicians' one-month 
teaching rotation with the intervention occurring at mid-point in 
the rotation. Forty-six attending physicians from 4 hospitals 
participated in the study. H 

I hB , results of the study indicated that teachers perceived 
7™ Seminar M^hod to be beneficial (Skeff, Campbell & Stratos, 
l?B3; Skeff, Campbell, Stratos, Jones «< Cooke, 1984) 
Participants were able to define aspects of their teaching which 
neederj improvement, and reported changes in their teaching 
performance. On the sel f -assessments conducted early and late in 
their teaching rotation, teachers who attended the Seminar 
reported increased use of instructional skills and teaching 
methods related to teacher-trainee communication. 

in**?"* 4 ? 9 " ° f . Vi ? e ° tape5 of actual instruction provided 

TrlillT r ^l P °Lt f ° r th !,. positive effect °* the method. 
Trained raters who were blinded to experimental assignment 
(treatment vs. control group) and to the chronological ord™ of 
the tapes (early vs late in the teaching rotation) ra?eo the 
tapes using scales based on the educational concepts of learning 
climate, communication of the teacher's expectations, control of 
the teaching session, evaluation and feedback, techniques to 
increase understanding and retention, and stimulation of fu-ther 
learning. Ratings were made on both the teachers' effort or 
frequency of behaviors, and quality of behaviors in each of these 
categories. A though post-intervention differences were not 
detected on all scales, differences which either reached or 
approached statistical significance were detected on 4 of the 
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scales, including Learning Climate <p«.03>, Control of the 
nl? 9 8<p>oi 2 n { P m 'Ol>, Techniques to Increase Understanding 
<p«.04>, and Feedback <p-.07| Analysis of Covariance). The 
seminar group was favored on each of these scales. 

teaches" 1 Zv.Ii "* uden **' and houseofficers' assessments of the 
teachers revealed mixed results. All students and 

!t C ^!' " h ° W * rB blinded to th » experimental assignment of 
tneir attending physician, were asked to evaluate their teachers' 

tZtZ^ll Barly Tt late in their teaching rotations. No 
f^" "?r? d «*«cted between experimental and control 
hon™" I" ^ition to rating teaching performance, students and 
housestaff were asked to rate the impact of their attending 
physicians upon their learning in several categories, including 
knowledge, clinical skills, patient communication skills? skiUs 
of ongoing learning, intercollegeal relationships, efficient use 
^T*«7tTf * if 7" t0 conduct research, and desire to practice 
clinical medicine. Although the group differences on these 
categories reached statistical significance in only one Category 
(patient communication skills, p-.03>, the mean ratings Savored 
^L3r 9r ? UP 10 6 °* the 8 "tegories. Thus, although 

D^nrmL.. *h ^IT" 1 ** a ° Y differences in teaching 
performance, they did perceive group differences in their 
teachers* impact. 

T he combined results of these studies indicate that 
and ^It Tho xf i m P ro ^ in 9 clinical teaching can oe developed 
HnLJ£ L effects of those methods can be documented. 

However, another barrier to the improvement of clinical teachers 
as a whole must still be overcome. In order for teaching 
Jn Pr ?K«« en Tf thods to make an impact, teachers must participate 
ln„ them. It is our belief that high levels of participation in" 
f^ Y teaching improvement method are dependent upon the inclusion 

charter! «t^« * T^**? ^ ° f characteristics. These 

characteristics must take into account certain attributes of 
clinical teachers. We postulate that methods should incorporate 

th* t^hf CtSriSt K CS ' Fir5t ' the method must b * relevant to 
Lnnd 9 Z°h \ enc °untered by attending physicians. 

Second, the method must provide educational tools or concepts 

ac? vefv in t0 l th \* te ^ hin9 Setti ^' Third ' the method ^ 
actively involve teachers in the decisions regardino their 

teaching practices. Fourth, the methods must be practical, both 
™ f t } mB commitment of participants and resources 

* or ^Cementation. Fifth, the method must be 
conducted by a credible facilitator. 

Based upon the findings from our own research, we believe 
that methods which are proven effective and which incorporate 

hL« ^ B ! " h f VS thS 9 reatest Potential to reach the 
ultimate goal of improving clinical teaching in institutions 
across the country. However, the attainment of that goal depends 
™?^^? n f *7 eS<Sa x C !! efforts ' Further development and 
fZ it?LJ S*t i0 ?S* l e t Cf ? ing * "Pavement methods is needed. 
Few studies have attempted to examine the correlation between 
teaching improvement and learning. Studies which examine the 
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issues of institutional as well as the individual receptivity to 
teaching improvement methods are essential if effective 
dissemination of methods is to occur. Because of the importance 
of clinical teaching, continued research is essential. 
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